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I. INTRODUCTION 


Due to cost overruns, Congressional concern, anda 
continuing need for better planning estimates, it is impera~ 
tive that new techniques be developed and cld techniques 
refined in order to obtain better estimates for major weapon 
system procurement and construction. Along with these tech-~- 
niques a better understanding of the factors and forces that 
Getermine cost is required. | 

The area of concern in this paper is with Naval ship 
procurement and construction costs. The cost of a ship is 
a result of many factors and forces all of which it would be 
impossible to define and msasure. Thus this cost is subject 
to variation. When estimating the cost of a ship it is 
necessary to provide both the estimate itself and as clear a 
picture as possible of the variability surrounding the ; 
estimate. 

The general objective of this paper is to analyze the 
variability of ship cost estimates with respect to the Joint 
Generalized Least Squares (JGLS) estimation technique, and 
the Least Squares (LS) regression estimation technique. It 
is hypothesized that the Joint Generalized Least Squares 
Estimation technique takes advantage of additional informa- 
tion available and allows a more meaningful statement of 


the variance of a ship cost estimate. 
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A. NAVAL SHIP PROCUREMENT AND CONSTRUCTTON COSTS 


Naval ships may be thought of as major weapon systems 
consisting of numerous subsystems including: 


Propulsion 

Hull 

Weapons and fire control systems 
Auxiliary 


There are two basic methods used to predict ships costs. 

One method is to estimate the construction costs for each 
subsystem, which are then summed to obtain total ship cost, 
(Ref. 4 and 6]. The other method is to estimate total ship 
cost by using the performance and operational characteristics 
such as, speed or number of missile launchers as explanatory 
variables, [Ref. 2-3]. 

The first method is the » : of concern in this paper. 
Here the subsystem costs are estimated by using the physical 
and performance characteristics of the ship as explanatory 
varlables, normally utilizing the Standard Linear Least 
Squares multiple regression technique. Weight is often used 
as a primary explanatory variable in addition to many other 
msharacteristics. In order to make meaningful statements 
about the variability of the total cost of the ship some 
aggregation technique must be employed on the individual 
subsystem relations. The aggregation technique used depends 
upon the assumptions concerning the correlation of distur- 
bances that exist between the subsystem relations. if the 


assumption of independence between subsystem relations can 
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be made ( a very restrictive assumption) straightforward 
linear combinations may be used to estimate total cost 
variance and prediction intervals; call this method LS 
(independence). This would seem a highly suspect assumption 
due to the interdependencies of subsystems aboard ships. 

A more reasonable assumption would be that there are corre=- 
lations between subsystems. If these interdependencies are 
recognized, methods do exist to make more meaningful state- 
ments about the uncertainty surrounding total cost. An 
extension of the least squares method may be made by con= 
structing an eataueced covariance matrix of the least squares 
estimates, assuming correlated disturbances; call this method 
LS (correlated). Finally, if correlations between subsystems 
are assumed, the joint generalized least squares technique 
allows this information to be used in determining a set of 


joint estimates and in constructing an estimated covariance 


matrix of the joint estimates. This assumption is less re- 
etrictive than the independence assumption and in fact 
should provide more meaningful results; call this method 
JGLS. Discussion and develonment of these three methods is 
contained in Section II, Nature of the Problem and Section 


III, Methodology of Joint Generalized Least Squares Estimation. 
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II. NATURE OF THE PROBLEM 


A. RECENT SHIP COST ESTIMATING MODELS AND THE TREATMENT OF 
UNCERTAINTY IN AGGREGATE PREDICTIONS. 


1. Resource Management Corporation Report CR-058 to 
NAVSHIPS » | 


Resource Management Corporation derived a statistical 
cost model for NAVSHIPS in which ship construction costs are 
estimated by subsystem and then aggregating these costs to 
arrive at Basic Contract Cost, and Total Ship End ae The 


following subsystem breakdown was used: 


1 iwi 6 Outfitting 
2 Propulsion 7 Armament 
3 Electrical 3 Design and Engineering 


4 Communication and Control 9 Construction Services 
5 Auxillary 
The summation of these nine cost categories plus profit and 
overhead was defined as basic contract cost and formed the 
nine-subsvstem cost model. RMC also developed a condensed 
four-subsystem cost model composed of the following categories: 


lL Hull Group : Hull, Design and Engineering, 
. Construction Services 


2 Propulsion Greup : Prepulsion, Auxiliary 


3 Armament Group : Armament, Electrical, 
Communication and Control 


4 Outfitting Group : Outfitting 


Again, the summation of these four cost sategories plus 


profit and overhead was defined as basic contract coast. 
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In determining total end Sate RMC used NAVSHIPS 
records of the Shipbuilding and Conversion, Navy (SCN) fund. 
NAVSHIPS hardcore cost was subsequently defined as basic 
contract cost plus miscellaneous end costs and electronics 
end costs. The total end cost then became NAVSHIPS hardcore 
cost plus weapons end cost. CERs were developed from the 
data base for predicting basic contract cost and miscellane- 
ous end cost. No CERs were developea for electronics or 
weapons end costs. | | 


The models were developed for six different classes 


of ships: 
l. Aircraft Carriers Kk. Auxiliary 
2. Destroyer 5. Amphibious 
3. Submarine 6. Patrol/minesweeping 


The area of interest in the Hernon and McCumber paper, which 
will be described next, and also in this paper is with the 
destroyer models developed. Reference 6 gives the full 
details of the RMC study and results. 

Taking now a point of departure from the general RMC 
study development, their treatment of uncertainty will be 
discussed. The treatment of uncertainty involves basically 
two steps. The first step is to develop the best set of 


CERs from the data available based on a regression strategy 


which outlines the basic statistical properties to be used as 


criteria in the choice. The secerd step is to analyze and 


repurt as thoroughly as possible the variance which surrounds 


10 


Ste aN ean aan bok Mihaly EIR Pals © 


Lip ee et Fen Suen, 
nN Mess gts 0 ce eee Wc 
SEEMS ee ita ae ad PRD Pye eke PSEA ek SAME S 8 OE PRET SRE Br eee a eo 8 ee ge Menten, ia he 


the CERs developed and, particularly, their aggregation to 
obtain total cost. | 
Two points arise from the RMC study with respect to 
the treatment of uncertainty. In the first, RMC uses the 
coefficient of determination, R°, as a measure of the Pens 


ness of fit of the regression equation to the data, where 7 


The ratio of the sum of 

squares explained to the 

total sum of squares of Y 

adjusted for the mean. 
This statistic tends to overstate the goodness of fit as it 
does not take into consideration the degrees of freedom. A 
more acceptable statistic would have been the adjusted 


coefficient of determination (adjusted for degrees of 


freedom) where Rene is defined below [see Ref. 7] 


2 
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where eu et om, 


ais the observation 


The second point concerning the reporting of total 
cost variance deals with prediction intervals on predicted 
total cost. The RMC study implicitly assumes that the errors 


in the estimates of costs for the individual subsystems are 


independent of one another (non-correlated), though they 
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fail to state this assumption directly. This seems highly 
unlikely since one shipyard produces several subsystems for 


a ship and the factors that contribute to the errors in the 
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estimates of one subsystem may very well be. the same or. 
partials the same as those that contribute to the errors 

in the estimates of another subsystem. The alloca‘’ion of 
overhead is one example. The factors that contribute to the’. 
errors in estimating costs for the propulsion and auxiliary 
subsystems might very well be the same since these subsystems — 
are in actuality very much dependent upon one anornes in the | 
ship itself. 

. Though it is not reported directly in the RMC study, 

Total cost variance is treated as the summation of the 7 


variance not expiained in the individual subsystem CERs. 


where V is total cost 


s,° is the variance of 


subsystem i 
L is the number of 


subsystems in the 
model 


Prediction intervals on total cost are renorted in 
tie RMC study as the summ tion of the individual subsystem 
prediction intervals, where predicted cost is the summaticn 


of the subsystem predicted costs. 
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c, = predicted cost for subsystem i 


= 
ti 


2 -] 
@ ? 
the contribution for the ith subsystem 


Acting as if the subsystems are independent may lead to 
substantial overstatements of the confidence one should have 


in any given total cost estimate as this. paper will endeavor © 


to show. 


2. Estimation of Destroyer Type Naval Ship 
Procurement Costs, by JD. M. Hernon and 
R. R. McCumber Jr. 


This paper is essentially an extension of the study 

Girection of the RMC study. The objective as stated was, 
"... To develop a model for the prediction of tctal 
procurement cost of destroyer type naval ships that 
increases in precision as input data is refined and, 
hopefully, approaches a level of quality acceptable 
in cost-effectiveness studies and eventually for 
fiscal planning purposes." 

Their approach was to first correct numerous defi- 
clencies noted in the RMC study. Because their concern was 
the prediction of total cost rather than the identification 
of basic contract costs and separate end cost, data was 
aggregated with the basic contract cost data as follows: 


@. Electronic end cost was added to command and control 
cost 


b. Weapons end cost was added to armament cost 


ec. Miscellaneous end cost was added to construction 
services cost. 
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Next they examined three models; a nine-subsystem cost 
model, a four-subsystem cost model and finally a single cost 
estimation equation. The final step was to use the models 


developed to estimate the total procurement cost of a de~ 


Pei ali at Riche adh dale acai lah Le 
: eer. 
ras ee tamer etn ne eT 


ag, Gt 
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stroyer type ship under seve lopment and compare the predic- 
eIGOE to the Peet available NAVSHIPS estimate. | 

The aay used as a primary criteria ‘for’ eoupacing. | 
the ‘prediction values of these models the estimate of total 
cost variance associated with each model. They used two 
methods to estimate total cost variance. The first method 
was called the summation method. This is the same as the 
treatment ee by RMC in their study, i.e., the summation 
of the variance not explained in the individual subsystem 
CERs. Again, this method requires the assumption that the 
errors of the individual CERs are independent of one another. 
Hernon and McCumber acknowledge the difficulties with this 
assumption and use this method to obtain a minimum total 
cost variance that may be attained by utilizing that 
particular set of:model CERs. 

The second method of total cost variance estimation 
involves the calculatio., of a total cost mean square residual 
value (MSR) for each model. The following method was used 


to calculate this value: 


N L : 
MSR = £ ([ f£ (Residual 7 D) i 
cd SE all | 
N- MeL 
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where N is the number of ships 


M is the number of variables utilized 
in ali CERs of the model] 


L is the number of CERs utilized in 
x | the. model 
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Essentially, the residual values produced for each CER for 


a given ship are summed. producing an aggregate of the indi- 


: vidual CER residual values. The total cost residuuls are | | 
( squared and summed fcr all observations (ships). If this 
quantity is then corrected for degrees of freedom, an esti-~ ' 
mate of variance is produced for a given model. Hernon and 
McCumber considered the MSR method to produce an upper bound : 
on the total cost variance estimate, a value below which 
the estimate of total cost variance is expected to lie. 
Hernon and McCumber did not report prediction inter- 
vals in their paper. Their treatment of total cost variance 
did not permit utilization of the standard linear least 
squares methodology for handling prediction intervals. The 
coefficient of determination which they reported was the 
same as the one which the RMC study used and is subject to 
the comments made earlier ponent Lt. 
3. RAND Report, "Confidence ir. Estimated Airframe Costs: 


Assessment in Argrepate Predictions", F.S. Timsor. 
and D.P. Tihansky 


This report addresses the general problem of confi- 


Sole gape eee ee MM. eee ; 


dence measures for multi-equation prediction models utilizing 


ee 


in the development specific results from airframe cost esti- 


mation. The report describes how prediction intervals can 
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be pevcutated for sums of component regressions. The re- 
gressions can be treated as independent and either Student 
| t or normal statistics used (the same treatment as the RMC 
E ae study), or the regressions can be treated as correlated and 
| normal statistics used. 

A simple method permits the determination of the 
degree of correlation between the individual regressions. 
It is assumed that there exists a correlated normal distri- 
bution for total costs. Consider two regressicns derived 
from a sommon data base consisting of the same number of 
observations. Assume the error terms of the two recrens ios 


are distributed bivariate normal with zero mean then 


(€5y> Eso) ~ N(0,2) 


where i refers to the observation number and 2 is the 


varlance-covariance matrix. 


Then if p is the correlation between Esq and Eso over all 
G 

observations op = He p may be estimated from the 
1 “2 


Sample as 


t 
on 


a 
Ss 
3 
(4 
we 
9 
bs 
zs 
fy 
ed 
7 
es 
Bo 
oe 
y 
a 
ne Q 
Lf rs 
vg S 
Fes cag 
ae 7 
s S 
4 # 
ie ‘ 
— 
Me: if 
i. 
aa s 
, y 
rat é . 
¢ 
Bi 
Fe, 
i: ¢ 
2 “ 
oe. ‘ 
Fe 
* 
% 8 
; 
ho, 
‘ : 
dl 
x 
iad = 
ia 
BS 
Ber. 
. & 
rer 
} | 
Br, 
By 
oe Hg 
i: 0 
s 
je oe 
Pf. 
“2 
eS 
BF 
y re 
mG 
es ja 
x ¢ 
ae 
em ¢ 
o e 
|: Se 
EE 
s é 
BA re 
Bs, 
*¥ a 
Es: 
oer : 
By é 
eS 
ae” 


r) 


eee Breet ee 
er ee Rape eek SEAS Ra ee te es 3 ; 
ta 


Ase ters 


POPE paws 


When ecet models are significantly correlated a 
method for treating the situation is described. This method 
assumes normality as a reasonably good approximation to 
the actual probability distribution. The true variance, 


W, of the sum of normal costs is expressed és 


=e 
t fy 
: O45 (1 +X oi X) Xo) 


where Xo is a specified set of values of 
the independent variables 


X is an observed n x K matrix of 
rank K consisting of values 
taken by K explanatory variables 


is the covariance between 
mocels i and j. 


An approximation for which is 


N 
a “qi “as 
a ence ra Sra | 


the sums of products of the 
residuals of models i and j 
over N observations for 
observation q. 


Prediction interval bounds for the aggregate cost are thus 


approximated at some confidence level a by 


‘ , pee 
Co + Nfa) : : 84,0 ¥ Ky ' (XX) Xo) 


where Co the predicted total cost, is the sum 


of the individual predicted costs of the 
subsystems. 
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In peosanitte prediction interval widths for the airframe 

cost model for independent normal and correlated normal 
assumptions at a fixed level of confidence, correlated ornate 
distributions generally give the widest intervals. 

It should be noted that in this formulation each 
subsystem CER uses exactly the same explanatory variables 
putting a very limiting constraint on the use cf this method 
in mits equation prediction models. In Naval ship cost 
models it is highly probable that there do exist correlations 
between subsystem CERs. The CERs developed in the RMC 
study and by Hernon and McCumber involve ditferent explana~ 
tory variables in the subsystem CERs, hence the above des- 
cribed technique may not be applied. The Joint Generalized 
Least Squares Estimation Technique is a method which will 
produce more accurate results than the least squares (inde- 
pendence) technique under the circumstances of correlated 


residuals and different explanatory variables. 


B. THESIS OBJECTIVES 

The objectives of the thesis are twofold: 

he su apply the method of joint generalized least 
squares to the ship cost preblem. 

2. Develop computer routines to carry out the calcula- 


tions associated with the joint generalized least squares 


estimation technique. 
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ITI. METHODOLOGY OF JOINT GENERALIZED 
j LEAST SQUARES ESTIMATION 
Joint generalized least squares is a method for taking 
ints consideration information that may be available when 


one is interested in the combination of several linear rela- 


‘tions which are related either because their coefficients 


are partly the same or because their Cisturbances are 
correlated. In the latter case one can say that the vari- 
ables that are neglected in the various equations are partly 
the same or at least correlated. The statistic used to 


measure the correlation between relations or subsystem 


errors is 
z : (Yay ~ Yag) y0 -Yyo) 
ia ee aes 
; (Yea 7 Yay) & ya - Yo) 


as was defined earlier in the RAND study on uncertainty in 


aggregate predictions. 


A. MODEL AND ASSUMPTIONS 

A complete development of the Joint Generalized Least 
Squares Method is contained in Theil [Ref. 7}. In using the 
joint generalized least squares method it is desired to 
formulate the estimates of the parameter vectors of several 
subsystem equations simultaneously. Suppose there are L 


equations of the form 


MaDFS Me Delle = MRT ON: eit? AP ME, OHI te” * en RN NE lt dh Ak ea Nar a ei at Se a aad 
FN RE eT ee EN ES te ce igh oe. 


stalk ated NU aha oie dar Sax segiba it ead: diate tier bas dae &saele es ht cad hcp 


i. 19 ee am RMAI a OR eile Th BES Ste pet SARIN EA PIE BORDEN 


pe ge WR Bee ESSE TTL SP ATOR ES ee eA APEC EC OT sg Pe oes kere ee OT Ea ae eee Oe, a8 ee” ee wea ee ae ek NS 
REA RRS PT BL AT OLS at Ee AE coy VE eee 'S 3 
ree “hae ere ce ake 


: tie ein fey ap ren " at -—; 
eR AE! CARRS ves a hey aE ena c3 se Lay 2 eRe Bee oe Are ye ALANS BEARER Seren ary: THERE aye NTR senna EN ; f 7; 4 
= sc eis A. ie ee a ner te ee 
: 2 i res 1M a Salle VEN ITED Cai OE TAT Lat oo a 


v4 = X48, + ay a taeekaty! vere sce ara E 


where ys ds a column vector of n observations 


X, is ann x Ks matrix of values taken 
‘ , by the Ks explanatory variables of 
, the jth diesvecen relation 


Bs is the corresponding parameter vector 
to be estimated 


Es is a disturbance vector 
Suppose also that each of these L subsystem equations meets 
the assumptions of the standard linear regression model. It 


is desired to combine the L equations in the following fomn: 


Then the joint generalized least squares formulation beccmes: 


Ye xB te 


1. Assumptions for Joint Generalized Least Squares 
a. The standard linear model holds for all of the 


L subsystem relations under consideration. 
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b. The disturbances of each subsystem equation are 


homescedastic and uncorrelated, 
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where Oy is the variance of the disturbance 
vector of the uh equation. 


c. Disturbances of different observations but of 


bor ee 
* ° Si 
¥ 
42 
2 
i: 
Ya 
24 
Hed 
i’: 
re, 
q 
¢ 


the same linear relation are assumed to be zero, 
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d. With respect to the covariance matrix of the 
disturhances of two different equations: 


E(€, 4€4,) E(€, s€5,) ee E(€45€n9) 


E(e E(e 
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The diagonal elements are contemporaneous covariances of the 


form (EQ se yg) and are assumed to be constant in the sense of 


being independent of a. These will be denoted by o The 


JR” 
off diagonal elements correspond to different observations 


and are assumed to be zero: 


E(e sng) a } # ; gs = lywcegl 
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which includes E(e,€,) = 05,1 as a special case. 

The disturbances of the L linear relations for the same 
observation are random drawings from a multivariate popula- 
tion with zero mean and constant covariance matrix. Thus 


the covariance of the complete vector e is: 


e e e = yi a I 
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where £ = (o5,4 


The L x L matrix % is the covariance matrix of Ce. Sens Eat 
for any a. 
The complete 8 vector may now be estimated by generalized 


least squares. The Aitken estimator for 86 is, 


B= -txt(r7) @ rxytxt(s7? @ Dy 


line Kronecker product of the m xn matrix A and the 
Pp Xx q matrix B is defined as the mp x nq matrix 


A, 45 ® ® & 475 


é 
a 


AaB. ‘ : 


For Sine properties of the Kronecker product see [Ref. 7, 
p. 305]. 
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for which the covariance matrix is, 


VAR(B) = cxt(272 fi xy? 


Since = is usually mUEDOWn:, it is estimated by the matrix 


of mean squares ond products of the least squares residuals. 


where e, is the least 
Squares ee sidual véctor 
of the 3° D equation and 
nis the number of 
observations. 


Replacing £ with S we obtain the joint generalized least 


squares estimate of the parameter vectcr 8 
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with the estimator for the covariance matrix 


VAR(b,) = Txr(s™ i Dye 


J 


Thus we have the essential information to carry out the 


joint generalized least squares estimation technique. 


B. TOTAL COST VARIANUE 


Consider the estimator for I: 
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An estimate for total cost variance may be obtained by taking 


the summation of all the elements of S 


Var (C) = it Si where 4 is a column vector 
; of L ones 
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This estimate will be used in the analysis of the ship cost: 


problem. 


-(¢. PREDICTION INTERVALS 


1. Prediction Intervals Utilizing Joint 
: Generalized Least Squares 


A method for determining a prediction interval | 
utilizing joint generalized least squares may be developed. | 
It must be assumed that the disturbances of the L linear | 
relations for the same observation are random drawings from 
a multivariate normal distribution with zero mean vector and 
a constant covariance matrix. Let C = ; Ys where C is | | 


joi 
total cost; then 


where X, is a row of explanatory variables 
[Xx 2+++sXa,] for the L subsystem relations 


A “Ts “ A A 4 

Now if C= ¢ Y, where C and Y, are predicted costs, then i 
j=1 i 
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“If the estimates utilizing the sample observations are 


i'Si for i'24 and Dy» the joint generalized least squares 


estimate vector, for 8, a prediction interval may be derived 


as 


74 
Ct (470) VE Si + Xy VAR(b,)X, 


2. Prediction Intervals for Correlated Subsystems 
Utilizing Least squares Estimation Techniques 


It is possible to provide prediction intervals by 
Single equation least squares estimation technique under the 
circumstances of correlated residuals and different explana- 
tory variables for each subsystem. When substantial corre- 
lations exist between subsystems in the: model the below 
described methodology can be expected to give more accurate 
statements about uncertainty in aggregate cost predictions 
than would the normal practice of disregarding the correla- 
tions and without utilizing simultaneous estimates. 

An estimated covariance matrix of the least squares 
estimates of the coefficients 1s obtained as will now be 


described. Consider the L subsystem equations of the form 
V3 P= X58, + so j aes etete ene a 


Postmultiply the sampling error of the least squares 
estimator, Bs» of By by the transpose of the sampling error 
of the estimator, B,» of By. Then the covariance matrix 


for selections 1 and j may be described as 


See RA A OR NM Nee ec at 


TE PRINT er ERA E IELTS ARTI Mtn LO gf Ns io PR sere 
3 ] : ' Se ge RE Te Se, OR FON SORE MOE 


EL(By - 8,)(By~Bs)] = 055 (X1X,) 72g x, (x35) 


" or a eee a ee ee ee ry . ato § 
De eR ail = ae ee aii ah in m c 
, “ap rs 
wens wir a HOE OR: 
eel 
ay 
d 
Ate 
a & 
‘34 
a 
ve 
& 
y : “ ‘, 
3 
? 


where d,5 is the contemporaneous 
covariance, 
x 
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12%; are observation matrices — | 


(B, -B,) are sampling errors. 


This result will hold if all of the assumptions concerning 
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disturbances that were made for the joint generalized least 
squares method are accepted. These assumptions ape much 
less restrictive than those of the least squares (independence) 
method. 

Utilizing this concept the covariance matrices for 
@11 combinations of subsystem selections may be dete »mined. 
The estimates for ee for all subsystems are contained in 
S, the matrix of mean squares and products of the residuals. 
Letting Eaj = EL(B, ~ By)(B, - 84) a covariance matrix, denoted 
VAR(8), similar to the covariance matrix of the joint esti- 


mates may be constructed in the form shown below 
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If it is assumed that the disturbances of the L 
linear relations for the same observation are random drawings 
from a multivariate normal distribution with zero mean vector 


and a constant covariance matrix, a method for determining 
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a prediction interval may be developed paralleling the 
prediction interval method utilizing joint generalized least 


squares estimates. The resulting prediction interval : 


a 


where C 3s estimate of total cast 


becomes 
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X, is a row vector of explanatory 
variables [Xy,,---X,J] for the 
L subsystem relations 


VAR(8) is the covariance matrix of the 
least squares estimates. 
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IV. DATA BASE 


There are three subsets of the data base that require 
discussion; contractor bid cost data, end cost data, and the 
independent variables. Contractor bid data was used for 


predicting subsystem costs. This was a compromise, the 


reason for which was that bid cost data was the most meaning- 


ful data available for the period under study (1954-1966). 
Cost accounting systems differed greatly among the various 
contractors and NAVSHIPS, making it impossible to obtain 
data on a uniform level of aggregation from any other 
sources. Bid prices themselves are subject to fluctuations 
due to factors in the shipbuilding industry such as overhead 
distribution, workload, level of expertise at a particular 


shipyard. The source of the bid data was the file of 


NAVSHIPS Form 4282.2, UNIT PRICE ANALYSIS-~BASIC CONSTRUCTION, 


which lists contractor estimates for the nine different con- 
struction cost Groups , subdivided into three categories; 
direct labor, direct material and overhead costs. The 
peunce of end cost data was the NAVSHIPS records of Ship- 
building and Conversion, Navy (SCN) fund. There are forty- 
one physical and performance characteristics for each ship 
which are contained in the RMC data base. These character- 
istics are essentially design parameters such as maximum 
speed, maximum draft, hull, propulsion weights, etc. They 
are utilized as candidates for independent variables in the 


models developed. Reference 4 and reference 6 give more 
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detailed descriptions of the entire data base. Appendix A 
gives a description of Ship's Characteristics used as ex~ 
planatory variables. Appendix B gives a description of 


basic contract cost categories. 


A. DATA ADJUSTMENTS 
1. Bid Cost Data ; 

Contractor raw bid data was adjusted in four specific 
ways. to remove cost variations due to factors other than 
ship's characteristics as follows: : 

a. Learning effect - when the cost of ship construc- 
tion decreases progressively with each ship in a procurement 
lot. 

b. Temporal effect - which takes into consideration 
variations of prices, productivity and wage overtime. 1965 
indices were used. 

c. Installation of government furnished equipment. 

d. Cost of plans from external sources. 

The order of adjustment was as follows: 
(1) Application of learning curves. 
(2) Adjustments using 1965 indices. 
(3) Addition ot the cost of GFE and plans. 
Details of these adjustments are found in Ref. 4 and Ref. 6. 
2. End Cost Data 

End cost data was adjusted in much the same way that 

contractor bid data was adjusted. Three specific adjustments 


were made to the raw end cost data. 
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a. Treatment for learning effect. 

b. Adjustment for temporal effect using 1965 indices. 

c. An adjustment for nuclear technology with propul- 
sion costs. 


Details of.these adjustments are found in Ref. 4 and Ref. 6. 


The data base is published separately as APPENDIX H of Ref. 


4 and is a CONFIDENTIAL document. 


B. DATA BASE STRATIFICATION AND COST GROUP MODELS 

Hernon and McCumber noted that some DLG type ships had 
significantly higher costs in the areas of hull, outfitting, 
construction services, weapons end cost, end electronics 
end cost. In addition the DLG ship was considered to have 
a different operational mission than the smaller, less 
expensive destroyer type ships. Thus, two basic data base 
stratification levels were examined: 

1. General Data Base: DD/DDG/DE/DEG/DLG (36 Ships) 

2. Escort Data Base : DD/DDG/DE/DEG (27 Ships) 

Using both of the data bases, CERs were developed using 
two different methods of cost disaggregation schemes which 
are scanned in this paper. The coding system as developed 
by Hernon and McCumber is contained in Table I and will be 


used for easy reference. 
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TABLE I 


DATA BASE STRATIFICATION LEVELS AND COST GROUP MODELS 


MODELS B/C_- 9 COST GROUP CERS 
Hull Cost 

Propulsion Cost 

Electrical Cost 


Communication & Control + Electronics 
End Costs 


Auxiliary Cost 

Outfitting Cost 

Armament + Weapons End Costs 
Design & Engineering Cost 


Construction Services + Miscellaneous 
End Costs 


MODELS D/E - 4 COST GROUP CER 
Base Cost = Hull + Outfitting 


CER CODE 


General 
Level 


Bel 
B=-2 
B-3 


B-4 


B-5 
B-6 
B-7 
B-8 
B-9 


Del 


Engineering Cost = Propulsion + Electrical D-2 


+ Auxillary 


Payload Cost = C & C + Armament 
+ Electronics End Cost + Weapons 
End Cost 


Construction Cost = D & E + Construction 
services + Miscellaneous End Cost 


D-3 


Escort 
Level 


ERE ELE LT eI RT I LT ETE RA RR IES 
1 V. ANALYSIS 

q The general scheme of analysis was to apply the joint 

1 : generalized least squares method as has been developed to 

} the ship cost problem. In doing so computer routines were 

{ developed to carry out the indicated calculations associated 

} with juint generalized least squares. Computer routines | 

Hl were also developed to solve the problem utilizing the least 

i squares method in order to compare the results of the two ; 
T methods and more clearly determine the nature of gains by § 
i using the joint generalized least squares method. 
i A. GENERAL COMMENTS : 
7 1. Computer Programs 
{ A computer program was developed in order to perform 
| the joint generalized least squares analysis. Essentially, 
{ a data set is read in and then transformations to the data 
fi as programmed are conducted. The program then does the 
iz number of standard multiple linear regressions required (one | 
F for each subsystem CER). The residuals from the single 
i regressions are saved and utilized to compute a matrix of 
t correlations between selections. Next the program does the | 
a joints generalized least squares calculutions; initially 5 2 | 
i is computed from the least squares residuals, next Das the 
{ parameter estimate vector is computed along with the co- 
fl variance matrix V(b,). Finally, the joint generalized 2 
F least squares prediction interval values are calculated. 
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Details of the program and a users manual are conteined in 
APPENDI2 D. The program was designed to be easy to use for 
analysis utilizing the joint generalized least squares method. 
Double precision was used to improve accuracy by reducing 
roundoff errors. The program will handle up to thirty-six 
observations and nine subsystem relations. Each subsystem 
relation may have up to four explanatory variables (including 
the constant term). It should be noted that larger dimensioned 
problems may be possible but computer capacity becomes a 
constraint to be concerned with. 

A computer program was also developed to perform 
the calculations required to compute a least squares predic- 
tion interval assuming independence between subsystem CERs. 
Essentially a data set is read in and then transformations 
to the data as programed are conducted. The progvam then 
does the number of standard muitinie linear regressions 
required (one for each subsystem CER). Then the information 
required from each individual rezression is used in the 
calculation of the prediction interval. This computer pro- 
gram is provided in Appendix D. 

Finally, a computer program was developed to perform 
the calculations required to compute a least squares predic- 
tion interval assuming correlated disturbances between sub- 
system CERs. Essentially, a data set is read in and trans- 
formations as programed performed. Next the covariance 


matrix of the least squares estimates as described in 
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are carried out to compute least squares correlated predic- 
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Section III.C.2 is constructed. Finally the calculations 


tion interval values. This computer program is provided 


in Appendix D. 

2. Criteria 

The principle criteria used for evaluating the joint 

generalized least squares method were the reduction in the 
covariance matrix of the estimate, the prediction intervals 
computed and the mean ‘quare residual values obtained from 
each observation. The first, a comparison of the diagonal 
elements of the estimated covariance matrix of the joint 
estimates and the estimated covariance matrix of the least 
Squares estimates gives an impression of the gain obtained 
by applying the joint generalized Jeast squares method 
rather than the least squares method. The second, the pre- 
diction intervals computed, gives the effect of the assumption 
of independent subsystem CER disturbances as compared to 
the assumption of correlated subsystem CER disturbances, 
and aiso a feel for the effect of using tne joint generalized 
least squares estimation technique. In the third, mean 
squared residual values (MSR) are obtained from each obser- 
vation, as the difference between observed and total cost. 
When these total cost residuals are squared, summed for all 


observations (ships), and corrected for the number of 
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observations, a statistic is obtained for comparison of a 
set of models.° 
. 3. Heteroscedasticity 

Hernon and McCumber used a log: linear model for 
their propulsion and engineering CERs in their nine CER 
group model and four CER group model respectively. This was 
done in order to correct for heteroscedasticity encountered 
with the linear model. The joint generalized least squares 
method will not allow calculation of prediction intervals 
when individual CERs are of mixed linear and log linear form, 
therefore, an alternate method was used to correct for 
heteroscedasticity in these relationships. 

Consider the relation as Bo + BX 5 Ey for 
a = 1,...,n where Ey is a random disturbance with zero 


expectation. If it is assumed that the disturbance variance 


a4 
i. 
1. 
4 
4 
en 
14 
}? 
R: 
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be 


is proportional to the square of the independent variable 


then of = Ken for a = 1,...,n and for some positive constant 


ee ee 


“Reference is made to mean squared residual (MSR) values 
in two contexts in tnis paper. MSR values refer to the sum 
of the squared total cost residuals for each observation 
divided by the number of observations. MSR values adjusted 
for degrees of t'reedom refer to the sum of the squared total 
cost residuals for each observation divided by the number of 
observations minus the number of parameters estimated minus 
the number of CERs utilized in the model. The first is a 
statistic for comparison between models, where as the second 
is an upper bound estimate on total cost variance as de~ 
seribed by Hernon and McCumber [Ref. 4]. 
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k. Dividing the values of the a” observation by Xu is 


thus equivalent to the following reformulation: 
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The cisturbances €,/%)4 ou Je Xai have a scalar covariance 
matrix (kI) under the formulation so that the assumptions of 
the standard linear model are now satisfied. Scatter plots 
of residuals versus independent explanatory variables were 
used to determine the variable causing the heteroscedasticity 
in each relation and the above described reformulation was 


used to correct for it. A full description of the method is 


found in Theil [Ref. 7]. 


4. Number of Observations 
Hernon and McCumber conducted an analysis of resid- 
uals to verify the normality assumption of the least squares 


regression technique and to identify any significant outliers. 


This resulted in the deletion of outliers in the development 
of several subsystem CERs. This caused the observations of 


a particular ship to be used to calculate some subsystem 


CERs, while not being used in others. Joint generalized 


least squares requires the same number of observations for 


all subsystem relations. Therefore, all observations were 


used in the joint generalized least squares analysis. In 


Appendix B of Ref. 4 Hernon and McCumber report the CERs 
developed including outliers in the data base. For purposes 


of comparison with joint generalized least squares results 
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deletion of outliers. Thus the general data base has thirty- 
six observations (ships) and the escort data base has twenty- 


seven observations. 


B. COST GROUP CER MODELS ANALYSIS | 
The nine cost group CER model consists é6f CERs as indi-  * 


cated and coded in Table 1. The regression strategy used 


ee - these CERs were used instead of the CERs developed by the 
2 

i 

i 


in the development of these CERs along with a discussion of 
“the results is found in Ref. h, It was necessary to use a 
scale factor of 1/100 for the variables ENGPAY, PWRLD, 
ELEWGT, C&CWGT, PRAXWT, LSW, ARMWGT and PROLSW (the weight 
variables used) to enable inversion of the matrices required 
in calculating the joint generalized least squares estimates. 
These factors are reflected in the computer output in Appen- 
dix C for the mine group CER models, but have been removed 

in the results reported in this section. 

The four cost group CER model consists also of CERs as 
indicated and coded in Table 1. No scale factor was re- 
quired. In deriving the condensed model an attempt was 
mate to make the subsystem categories as independent as 
possible, first with respect to the nature of ship design, 
and secondly with respect to the differences reported earlier 
in shipyard and contractor accounting practices. Details 


of the regression strategy and development of the subsystem 


CERs are contained in Hernon and McCumber,[Ref. 4]. 
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l. Results 


The following tables present four different sets of 
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CERs - one set for each of the two models employing the 
general data base, and one set for each Eris same two 
models emplcying the reduced escort data base. Following 
each set of CERs are tables containing correlations between 
selections for that particular model and selective comparisons 
of covariance matrices of ene least squares and the joint 
generalized least squares aeeuatée. The complete covariance 


matrices are contained in Appendix C, computer output. 
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TABLE IV 


BLOCK DIAGONAL COVARIANCE MATRIX COMPARISONS 
MODEL B - 9 CERs - GENERAL DATA BASE 
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JGLS LS 


HULL . 

©7293D-01 ~~. 3523D-02 -7392D-01 -.3578D-02 
.1960D-03 .1991D-03 

PROPULSION 


.1499D 02 -.2270D 01 .1294D-03 
05734D 00 -.5755D~04 
. 7885D-08 


~l244D 02 -.1994D 01 .1330D-03 
.5012D 00 -.5009D-04 
6428D-08 


ELECTRICAL 


-3025D-01 -.1964D-02 -.7572D-02 
~7613D-02 -.2417D-02 
~3206D-02 


~3377D-01 -.1597D-03 -.9330D-02 
.9372D-02 ~.3647D-02 
~4214D-02 


COMMUNICATION AND CONTROL 


22177D 01 -.1032D 01 -.4362D 00 
.6008D 00 .9698D~-01 
»1095D 01 


.2381D 01 -.1112D 01 -.7143D 00 
-6405D 00 = .1518D 00 
.1839D 01 


f z ; 


AUXTLIARY 


.6227D-01 -.5399D-02 
5425D-03 


-6439D-01 -.5612D-02 
»5639D-03 


OUTFITTING 


.1808D-01 ~.4824D-03 
.1510D-04 


.1978D-01 -.5352D-03 
»1675D-04 
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TABLE VII — ee | = 
BLOCK DIAGONAL COVARIANCE MATRIX COMPARISONS 
MODEL € - 9 CERs ~ ESCORT BASE 


_JGLS | LS 
HULL. 


~4421D-01 ~.2579D-02 


-4831D-01 ~-.2850D-02 
.17130D-03 - ia 


.1894D-03 
PROPULSION 


-T706D 01 ~.7609D 00 
. 8684D-01 


.5893D 01 -.5540D 00 
.6322D-01 


ELECTRICAL 


.2340D-02 ~.1152D-01 -.313 7-02 
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»2137D-02 


COMMUNICATION AND CONTROL 
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~1154D-02 
OUTFITTING 
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.2786+01 -.1039D-03 
. 4208D-06 
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TABLE IX 


BLOCK DIAGONAL COVARIANCE MATRIX COMPARISONS 
MODEL D ~ 4 CERs - GENERAL DATA BASE 


JGLS | LS 
BASE _D-1 
.1197D 00 -.3214D-04 .1251D 00 —.33B4D-04 
.1006D-07 ..1059D-07 
ENGINEERING D-2 | 
.1539D-06 -.1136D-04  .9565D-05 | .2336D-06 -.1905D-04  .3201D-04 
.1745D-02  -. 9690-02 .3165D-02 -.1898D-01 
.1022D 00 .1882D 06 


PAYLO:D_ D=3 
.5081D 91 -.1/26D-02 = .1422D 01 | .5498D OL -.1991D-02 .2016D 01 
-7672P-06 + -.1004D-02 .9495D-06  —. 1444-02 
-2470D O1 »3598D 01 
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: TABLE XI 
: BLOCK DIAGONAL COVARIANCE MATRIX COMPARISONS 
| MODEL E - 4 CERs - ESCORT CATA BASE 


BASE E-1 


-1056D 00 -.3761D-04 .1108D 00 -.39€7D-04 


Fs ‘ 
ae 
ef 
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a 
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~L456D-07 - 61533D-07 


ENGINEERING E~2 
~L727D 00 


oL479D-02 -.1452D-01 
-1657D 00 
PAYLOAD E-3 
-1052D 02 -.4401D-02 .3108D 01 
-2065D-05 -.1943D-02 
~3970D O1 


»1179D 02 -.5108D-02 .4255D 01 


«AS2D-05 -.2658D~02 
—e5426D 01 

CONSTRUCTION E-4 

»2226D O01 -.1993D-02 -.5692D-04 | .2374D 01 -.2120D-02 -.8667D-04 


-2050D-05 .1330D-07 


21932D-05  .3906D-08 


.8972D-07 »1238D-06 


The following table indicates correlations of greater 


than + .4 for the four models: 


TABLE XII 
MODEL CORRELATION SUBSYSTEMS 
B 424 Outfitting and Propulsion 
- .405 Outfitting and C&C + 
Electrical 
402 Construction and C&C + 
Electrical 
C - .449 Auxiliary and Propulsion 
- .418 Outfitting and Hull 
- .50 Outfitting and C&C + 
Blectrical 
aa iM Construction and C&C + 
Electrical 
D AUD , Engineering and Base 
ooo Construction and Payload 
E 490 Construction and Payload 


These correlation estimates do indicate significant degrees 
of correlation between subsystem CERs and would tend to 
provide evidence against a hypothesis of independence 
between subsystem CERs. 

The block diagonal covariance matrix comparisons 
show a reduction in the variance (diagonal) elements in ail 
cases and a reduction in the covariance (off-diagonal) ele- 
ments in the large majority of cases by the joint generalized 
least squares estimates as compared with the least squares 


estimates. This may be attributed to the fact that the joint 
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generalized least squares method takes into consideration 
the correlated subsystem disturbances in computing the 
joint estimates whereas the least squares method computes 
the individual subsystem estimates separately. 
2. Total Cost Variance 

Total cost variance for each model was computed 
utilizing three methods. The first method was to take the 
summation of the individual subsystem CER standard errors 
assuming independent subsystems. The seccnd method was to 
take the summation of the entries in the S matrix of mean 
squares and products of all sets of subsystem CER residuals, 
the estimate for %. The third estimate was obtained by 
summing the residual values produced by each CER for a given 
ship which gives the difference between observed and predic- 
ved cost for that ship as an aggregate of the individual CER 
values. The total cost residuals are then squared and summed 
for all observations (ships) and divided by the degrees of 
freedom, defined as the number of observations minus the 
number of parameters estimated minus the number or subsystem 
CERs, to obtain the mean squared residual value (MSR). ‘This 
method was used by Hernon and McCumber [Ref. 4] to form an 
upper bound on total cost variance. In essence, the summation 
method assuming independence prcvides a lower bound on total 
cost variance. The summation of the S matrix elements (S 
matrix summation), assuming correlated subsystems provides 
a midrange, more realistic estimate, between the pper bound 


(MSK method) and lower bound (LS Summation method). The 
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values for these three methods are contained in the following | 
4 f | 
2 table: | 
| 
TABLE XIII | 
| 
METHOD | 
MODEL (LS SUMMATION) (S MATRIX SUMMATION) (MSR) | 
| C sale 58.38 526.0 : 
D 7.86 36.54 58.3 | 
| E 7.04 27.47 43.6 ; 
| 
| | 
‘ 3. Prediction Interval and Predicted Costs ; 

Three prediction intervals were obtained for each 


model in the manner described in Section III.C, e.g., least 
squares with independence, least squares with correlations 
and joint generalized least squares with correlations. , 
The estimated total ship cost was computed with the least 

squares estimates in the first two cases and the joint esti- | | 
mates in the third. The results are summarized in the , 
following tables. There 1s a table for each model which 
contains the prediction interval length for each observation 
by each method. Also contained in each table are the abso- 
lute differences between actual and estimated cost obtained 
by using the least squares estimates and the joint estimates. 
The actual predictton intervals are contained in Appendix C. 


The signs of the value of the differences between actual 
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MODEL B: 
OBS LENGTH _ LENGTH 
LS(IND)  JGLS 

1 24.64 28.76 

2 24 23 28.54 

3 24.28 28.55 

qr 23.82 °28.37 
6 23.39 28.12 

7 23.38 28.11 
8 23.39 28.12 
9 23.38 28.12 
10 23.39 28.12 
11 23.39 28.12 
12 23.39 28.12 
13 23.37 28.12 
14 23.37 28.12 
15 23.97 28 £85 
16 eye: 28.74 
17 25010 28.74 
18 23.78 28.74 
He 24.07 29.12 
20 23.89 28.99 
21 23.84 28.84 
22 23.70 28.51 
23 23,34 26.29, 
24 23.33 28.27 
25 23. 36 28.29 
26 24.22 '28.78 
27 23.79 28.48 
28 23.56 28.34 
29 23.56 28.34 
30 2k 56 29.44 
31 24.12 28.99 
32 23.85 28.69 
33 23.85 28.69 
34 24 48 29.16 
35 23.19 28.83 
36 23.92 28.84 


TABLE XIV 


LENGTH 
LS (CORR) 


29.19 
29.10 
28.82 
28.58 
28.15 
28.15 
28.15 
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PREDICTION INTERVAL SUMMARY 


|A|LS 
ACTUAL~ 
ESTIMATED 
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TABLE _XV 
MODEL C: PREDICTION INTERVAL SUMMARY 
OBS LENGTH LENGTH LENGTH ~ |[A|LS |A|JGLS : 
LS(IND)  JGLS LS(CORR)  § ACTUAL- ACTUAL~ 
ESTIMATED ESTIMATED 
7 22.02 23.38 23.90 6.96 8.0 
2 21.73 23.17 23.56 2.02 2.79 
3 21.76 Pana 23.57 2.19 2.93 
y 20.71 23.02 23.35 10.58 | 10.05 
5 20.92 22.88 22.98 1.89 1.62 
6 20.92 22.82 22.95 1.83 1.59 
7 20.91 22.81 22.95 4, 32 4.10 
8 20.92 22.82 22.95 .89 64 
9 20.92 22.87 22.98 3.9 Naty) 
10 20.92 22.82 22.95 1.41 1.65 
| 11 20.92 22.82 22.95 13.67 13.42 
o 12 20.92 22.82 22.95 .03 22 
13 20.91 22.86 22.97 Nai 1.31 
] 14 20.914 22.88 22.97 4.62 4.86 
[ 15 paves0 23.46 23.58 1.43 1.18 
. 16 21.29 23.45 23.56 AL 79 
q 17 21.29 23.45 23.56 .98 1.36 
a 18 21.29 ~° 23.45 23.56 1.39 Len 
. 19 21. 38 23.66 2B ii 3.04 2.35 
a 20 21.38 23.68 23.79 3.01 3.48 
g eal 20.87 23.07 Ey) 24 76 
. 22 21.19 22.97 23035 1.80 1.75 
. 23 21.05 22.87 Bion Yi .60 095 
+ au 21.04 22.86 23.17 21.46 Baar 
z 25 21.30 23.01 23-40 3.96 3.58 | 
+ 26 21.28 23.15 23.38 2.95 3.31 
7 27 21.11 23.05 23.24 5.05 44d 
7 


a Pp wR ASA ALM Ard PRAIRIE AETV Be et eR gare get tim = nan ot eR A we) 
- Er ' ie » " % a o 
+ a ee OES ee eet RD 2 Bek deals 


TABLE XVI 


MODEL D: PREDICTION INTERVAL SUMMARY . 


54 


| 
: 
: 
| 
’ i » OBS LENGTH LENGTH LENGTH |A|LS |A| JGLS 
) LS(IND)°  JGLS LS(CORR) ACTUAL ACTUAL~ 
7 | ESTIMATED = ESTIMATED 
| 1 22.49 25.63 25.75" 7.33 6.70 
_— 2 20637 25.55 25 .68 ee .33 
—_ 3 22. 36 25,55 25.68 51 39 
) ; i 22.07 25, 38 25.45 7.01 7.30 
: 5 21.97 25.32 25.35 69 43 
PO 6 21.95 25 . 32 25.35 39 015 
RO 7 21.93 25.32 25 . 36 3.02 2.74 
; 8 21.97 25,32 25.35 54 81 | 
9 21.99 25.31 25.35 5.05 5.34 
= 10 21.97 25.31 25.35 © 2.84 .10 
i 11 21.97 25.31 25.35 12.22 11.97 
: 12 21.97 25.31 25.35 1.40 1.67 
| 13 21.99 25.31 25,3 2.63 2.86 
14 21.97 25.31 25.34 6.07 6.31 
15 22,07 25.86 25.90 84 1.05 
: 16 22.04 25.85 25.88 1.90 1.46 
: 17 22.04 25.85 25.88 BolT 2.03 
q 18 22.04 25.85 25,88 2.89 2. 4h 
1 19 22.71 25,82 25.86 2.65 2.88 
; 20 21.99 25.80 25.82 4, 33 3.86 
q 21 21.88 25.58 25.92 ag 2k 
1 22 22.04 25.53 25.65 4.82 heavy 
q 23 21.93 25.46 25.55 119 14 
q 2h 21.93 25.46 25.54 20.54 20.57 
4 25 21.95 25.46 25.55 4.0 3.96 
: 26 22.00 25.43 25.58 1.49 1.54 
: 27 21.88 25.42 25.50 4 86 5.29 
: 28 22.10 25.41 25.44 19.61 19.67 
. 29 Be 6 25.41 25 44 1.76 1.69 
30 23.56 26.27 26.52 18.78 19.54 
31 23.82 26.23 26.39 9.08 8.98 
32 23.26 26.16 26.34 5.74 5.88 
33 23.26 26.16 26.34 2.14 2.28 
3y 24, 39 27.04 27.40 4.0 5.59 
35 24.09 25.87 OF alld 5.25 4,68 
36 24.09 25.87 oy ola 2.59 2.01 


TABLE XVII 


MODEL E: PREDICTION INTERVAL SUMMARY 


OBS LENGTH LENGTH LENGTH |A|LS [A|JGLS - 
LS(IND) JGLS LS(CORR) ACTUAL- ACTUAL- 
ESTIMATED ESTIMATED 

1 21.39 a 22.03 4.70 4.59 
2. 21.15 21.58 21.79 88 1.04 

3 21.20 21.55 . 21.79 48 63 

4 20.80 21.47 21.59 9.35 ~ 8.91 

5 20.49 21.32 21.35 2.07 1.79 

6 20.49 21.29 21.33 1.68 1.27 

if 20.48 21.29 21.34 2.74 3.37 

8 20.47 21.29 21.33 7h . 32 

9 20.49 21.32 21.36 3.39 3.79 
10 20.47 21.29 21.33 1.56 1.97 
11 20.47 21.29 21.33 1,.53 13.10 
12 20.47 21.29 21.33 ote 53 
13 20.50 21.34 21.36 90 1.30 
14 20.50 21.34 21.37 454 4.93 
15 20.88 22.05 22.11 2.56 2.29 
16 20.88 22.04 Bivins 48 20 
17 20.88 22.04 22.11 .07 e3y 
18 20.88 22.04 22.11 50 78 
19 20.59 21.94 22.00 2.52 2.16 
20 20.59 21.92 21.99 3.85 42k 
21 20.13 21.39 21.44 99 1.34 
22 20.71 21.59 21.80 3.25 2.85 
23 20.44 21.39 21.53 214 57 
24 20.42 21.38 21.53 20.77 21.21 
25 20.42 21.38 21.53 3.65 3.20 
26 20.57 21.46 21.61 2.72 2.47 
27 20.31 21.34 21.45 4.71 4,92 


A ea 


and estimated cost for both the least squares and the joint 
penerald ned least squares estimates are the same in all cases 
and have been dropped in the table for simplification. 

The prediction interval.iength becomes longer pre- 
gressing from least squares (independent) to joint generalized 
least squares and finally to least squares (correlated). 

Both least squares (correlated) and joint generalized least 
squares provide apervals which are significantly longer than 
those produced by the least squares (independent) method, 
while the joint generalized least squares method provides 

a small decrease in prediction interval length over the 
least squares (correlated) method. The latter two methods 
represent the prediction interval length more accurately 
assuming that there are correlations between subsystem CERs. 
Both of these methods require approximately the same degree 
of computational difficulty and thus it would appear that 
the joint generalized least squares technique offers the 
best alternative in accurately stating prediction intervals. 

The mean square residual [MSR] value, not adjusted 
for degrees of freedom, was computed for the least squares 
estimates as compared to actual cost as was the same value 
for the joint estimates. It was intended to use these values 
as a way of comparing the two methods to see which provided 
the pesereatimeteer But further examination ied to the con- 


clusion that there is no guarantee in using this technique 


that one method will be consistently better than the other. 
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In the joint generalized least squares case with heterosce- 
dasticity the formulation of the problem is such that the 
length of the residual vector, after a Epanenermatior. is 
being minimized. Hence the solution we obtain is for the 


problem: 


Min (Y - x8)(z7+ @ I)(¥ - x8) 
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where (£7 x I) is an unknown nonsingular 
matrix which is estimated by (S ~ x I) 


and for which b, = cx'(s7* @ 1)xy74x"(s7) @ I)Y is the 


joint generalized least squares estimator as developed in 
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Section III. This estimator, Dy. in fact does not minimize 


es re 


the length of the residual vector. Therefore the MSR method 
will not discriminate between the two methods of estimation 
in this case. For a complete discussion of this preblem see 
Theil (Ref. 7). | 


The MSR results are contained in the following table: 


TABLE XVIII 
MODEL 
B C D E 
LS MSR Wo.4 = 27.5 49.7 58.3 
JGLS MSR 50.4 32.0 61.2 36.2 


In models B, C and D the least squares estimates come out 


ahead whereas in model E the joint estimates come out ahead. 
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The total cost predictions by the least squares 


estimates and the joint estimates are very close when com- 


pared to each other. The Summary Tables present these 


values for comperison. On a worst case basis the differences 


between these two methods for each model, indicating the 


particular observation, are as follows: 


MODEL/OBSERVATION 
B/34 C/1 D/ 36 E/7 
SIZE OF DIFFERENCE 1.44 1.04 1.59 63 
$/MILLION 


In no case is this difference greater than three percent 


of total estimated cost. 


Utilizing the additional information available due 


to the correlations between subsystems, joint generalized 
least squares estimates should provide a more accurate 


weighting of the variables in each CER. This is important 
in assessing the contrioution to subsystem cost of a 


particular variable. For example, consider the CER B-6: 


OUTFITTING COST 


436 + .000386 [LSW] (Least Squares) 


~549 + .000350 (LSW] (Joint Generalized 
Least Squares) 


OUTFITTING COST 


The coefficient of light ship weight (LSW) reflects the 


change in outfitting cost per pound for a change in y,ight 


Ship weight. The joint generalized least squares coefficient 
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should provide a better refiection of the contribution of 


light ship weight to outfitting cost for this CER. 
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VI. CONCLUSIONS 


It has been demonstrated that the joint generalized 

least squares estimation technique, by taking advantage of 
the additional information which is provided when correla- 
tions exist between the residuals of subsystem CERs in ag- 
gregate cost estimating, provides more accurate and meaning- 
ful statements about predictions, the total cost variance | 
surrounding the predictions, and the prediction intervals. 
The method involves an increase in computational difficulty 
when compared to one assuming independence between subsystem 
CERs, but gives a more accurate statement concerning the 
estimates and their uncertainty. A computer program has 
been provided which is readily usable in conducting joint 
generalized least squares analysis and the additional time 
required would be minimal. 

The predictions utilizing the joint estimates provide 
gains in a more accurate weighting of the variables in the 
subsystem CERs. This allows a better factor analysis of 
the contributions to subsystem cost and hence to totai cost. 

The estimate for total cost variances used in the joint 
generalized least squares method provide a more meaningful 
statement taking into consideration the correlated distur- 
bances. The least squares estimate assuming independence 
tends to substantially understate the total cost variance 


in the situation analyzed. 
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The prediction intervals obtained utilizing the joint 


aes “et toad! 
pt Seek Me le etl reel er, 


f. 


generalized least squares method represented a slight gain 


rain dae 


-over those obtained by the least squares method, assuming 
correlated disturbances. Both these methods provided more 
accurate prediction intervals under the assumptions made; 
however, with equal computational difficulty the joint 
generalized least squares method appears the superior of 


the two. 


It should be emphasized that the joint generalized 


least squares method involves less restrictive assumptions 
than the least squares method. The assumpvion of correla- 


tions between subsystem CERs is a more reasonable statement 


of the true relationship as was shown by the tables of 


correlations between subsystem CERs. The least squares 
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method does in fact tend to understate the uncertainty 
surrounding the cost estimate. Joint generalized least 
squares by utilizing this additional information gives more 
meaningful results in the derivation of the estimate and 
the statement of uncertainty surrounding the estimate. 

The overall gains achieved by the joint generalized 
least squares method overshadow the small additional cost. 
This application to destroyer type ship models may be extended 
to any other situation where one is interested in aggregate 


predictions of the same nature. 
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APPENDIX A 


DESCRIPTION OF SHIP'S CHARACTERISTICS USED 
AS EXPLANATORY VARIABLES IN THESIS 


Characteristic 


Light Ship 
Weight 


Hull Weight 


Propulsion 
Weight 


Electrical 
Weight 


Commmnication 
and Control 


Auxiliary 
Weight 


Outfitting 
Weight 


Armament 
Weight 


Camplement 


Maximum Shaft 
Horsepower 


Symbol Units 

LSW long tons 
HULWGT long tons 
FROWGT long tons 
ELEWGT long tons 
C+CWGT long tons 
AUXWGT long tons 
QUIWGT long tons 
ARMWGT long tons 


COMP integer 


RANGE nautical 


miles 


Definition 


Weight of ship complete with 
all items of outfit, equip- 
ment, and machinery but 
excluding cargo, stores, crew, 
eta. Includes lead ballast 
for surface ships but not 

for submarines. 


These are the weights of the 
seven groups as described in 
Bureau of Ships Consolidated 
index of Drawings, Materials, 
and Services Related to 
Construction Conversion. 


Allowance for all officers 
and men on board. — 


Total power that can be applied 


continuously to the shafts 
under designed operating 
conditions. For subs this 
applies to surface operation. 
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19. 


20. 


el. 


Characteristic 
Series 


DE or DEG 


symbol 
SERIES 


DEDEG 


Prototype Dnmy PROTO 


Number of 
Generators 


Power Loading 
Factor 


Award Date 


Generator 
Capacity 


Propulsion and 
Auxiliary 
Weight 


Prototype 


Light Ship 
Weight 


Missile End 
Dummy 


NO-GEN 


PWRLD 
AWARL 


TKWCPY 


PRAXWT 
PROLSW 


MS-END 


Units 


integer 


integer 
integer 


integer 


years 


kilowatts 


long tons 


integer 


PRT NL Pee 


Definition 


A number that represents 
the positior. of a ship in 
a series of similar ships. 
For example, DD 936 to 
DDG 39 have the same basic 
design except for missiles 
and constitute a series of 
39 sinilar ships. DD 936 
would be assigned series 
number 1 and DDG 30 would 
be assigned series number 


Henares ot, able ine ienai sacsaseys ee 
i ee 


1 = DE or DEG; zero otherwise. 
1 = protytype; zero otherwise. 


Number of ship service 
generators 


Ratio of maximim shaft 
horsepower to full dis- 
placement. 


Last two digits of the vear 
in which the contract was 
awarded. 


Total maximum output of 
all generators. 


Propulsion weight plus 
auxiliary weight. 


For prototypes, this takes 
on the value of LSW. For 
non~prototypes, it has 
the value zero. 


0 = no launchers; 1 =a 
launcher at one end of the 
ship; 2 = a launcher at 
each end of the ship. 
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23. 


24. 


25. 


Characteristic 


Armament 
Weight-to- 
Light Ship 
Weight Ratio 


Engineering 
Weight 


Payload Weight 


Engine and 
Payload Weight 


Symbol 


ENGWGT 


PAYWGT 


ENGPAY 


Units 


long tons 


long tons 


long tons 
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Definition 


Ratio of armament weight 
te light ship weight. 


Total weight of all 
propulsion, electrical, 
and auxiliary equipment. 


Total weight of all C+, 
armament and outfitting 
equipment. 


ENGWGT + PAYWGT 
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Category 


APPENDIX B ‘ 


BASIC CONTRACT COST CATEGORIES 


Categery Name 
Hull Structure 


Propulsion 


Electric Plant 


Commmication 
and Control 


Auxiltary 


Outfit and 
Furnishing 


Armament 


Design and 


Engineering 
Services 


Construction 


Inciudes 


Shell plating and planking, . logitudinal 
and transverse frames, decks, super- 
structure, armor, etc. 


Boilers and energy converters, propul- 
sion units, uptakes, propulsion control 
equipment, feedwater and codensate 
system, etc. i 


Electric power generators, power 
distribution switchboards and cables, 
lighting systems, etc. 


Navigation equipment, interior commni- 
cation equipment, fire control systems, 
radar systems, radio communications 
systems, sonar systems, etc. 


Heating, ventilating, ‘air conditioning, 
plumbing, elevators, arresting gears, 
rudders, etc. 


Hull fittings, nonstructural buikheads, 
paintings, equipment for work shops, 
furnishings for quarters, etc. 


Guns and gun mount, ammmnition handling 
‘and storage systems, other weapon systems 
handling and storage systems, etc. 


Contract drawings, working drawings, 
technical manuals, lofting, mock-up 
and models, etc. 


Staging, scaffolding and cribbing, 
launching, trials, cleaning ship, 


drydocking, etc. 
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Miscellaneous 
End Cost 


Weapons 
End Cost 


Electronics 
End Cost 


APPENDIX B (CONT. ) 


END COST CATEGORIES 


Disaster costs; cost of hull, mechanical and 


electrical changes; post-delivery costs; etc. 


Weapons costs after contractor delivery; 
missile, ASROC systems; etc. 


Electronics costs after contractor delivery; 
radar, NIDS, fire control systems; etc. 
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APPENDIX C 
COMPUTER OUTPUT 


MODEL B - 9 CERs - 36 OBSERVATIONS 


MULTIPLE FECRESSICNewee eCENRAL 
SELECTICNeceoe I 


SELECTICN CAREC O z 114 
LEAST SQUARES REGRESSION CCEFICIENTS 


CC4CEZ1 0.128546 
STC. ERRCR CF ESTIMATE= 0.6C5304 


COVARIANCE MATRIX CF THE ESTIMATES ~ 


0.78zE4C-Ci ~C.278ESC-C2 
~C.37EESET-CZ €.2108CC-C3 


ACULSTED MULTIPLE CCRRELATICN CCEFICIENT 0.72013C 


WMLLTIPLE FECRESSICN. eee eCENRAL 
SELECT ICNecese 2 


SELECTICAN CAREC O 2 2333: 


LEAST SCUARES REGRESSIGN CCEFICIENTS 


58.€EE71C ~E€.CS1LE4S C.00C72S 


STC. ERRCR CF ESTIMATE= 1.GL3978 
CCVARIANCE MATRIX CF THE ESTIMATES 
O.3CiSCO CC -C.457¢210-ClL 0.2€07590-05 
“O.457210-Cl CeliSS10-Ch -0.115920-05 
CoZ2EC750-C5 -C.LiS920-C8& © LSEE4D-0S 
ACJUSTED MLLTIFLE CCRRELATICN COEFICIENT 0.75436C 
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WULTIPLE RECRESSICNessee 
SELECTICNeceee 3 


SELECTICN CAREC 0 4 2162 
LEAST SCLARES FE 


Co 14EE42 C.286162 
STC. ERRCR CF ESTIMATE= 


GENRAL 


CFE ESSIGN CCEFICIENTS 


0.261561 
0.25375C 


X CF THE ESTINATES 
C-C€3 -0-1C1790-01 
B-Ci -C.2S7€5D-02 
C-C2 0.459€70-02 
A 


TICN CCEFICYIENT 0.6€CS27 


MULTIPLE RECRESSICN.e. eeGENRAL 


SELECTICNescee 4 


SELECTICN CARE C F 21726 


LEAST SCUSRES REGRESSICN CCEFICIENTS 


“C.SC27C1 3.1738E&4 


- STE. ERRCR GF ESTIMATE= 


Me Te mA eh wee Bene, MeN Nein A Age aad HIRT em ES Fe ee eck eae ate 
5 athe 


C.347513 
32 €43863 


CF THE ESTIMATES 
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WLLTIPLE REGRESSICN: eee eGENRAL 
SSELECTICNcoeee 5 


SELECTION CARC Cc € 118 | 
LEAST SCLARES REGRESSICN COEFICIENTS 


0.C2é3€2 0.224177 
STC. ERRCR CF ESTIMATE= 0.570275 


COVARIANCE MATRIX CF THE ESTIMATES 


O.€81L7EC-Ck ~C.59424C-C2 
-C.554240-(2 €.557C70-C3 


ADJUSTED MULTIPLE CCRRELATICN COEF ICIENT 0.703815 


MULTIPLE FEGCRESSICNe eee eGENRAL 
SELECTICNesese € 


SELECTICN CARD C 7 121 
LEAST SQUARES REGRESSION CGEFICIENTS 


C.43582€ C.C2e5 76 
STC. ERRCR CF ESTIMATE= o21SE&34 


COVARIANCE MATE 


O0.20S5470-Cl ~C.5E€E 


IX CF THE ESTIMATES 

cs 

“0.56€6SC+03 C.i77370- 
EL 


ACJLSTED MULTIFLE CCRE TICN COEFICIENT 0.703134 
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STO. ERRCR CF ESTIMATE= 3 153802 
CCVARIANCE MATRIX CF TRE ESTIMATES 
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SELECTICNe eee 8 


SELECTICN CARE C S$ 22022 
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~ 1.012527 (0.653561 Co15172S 
-S$TC. ERRCR CF ESTIMATE= 1.2C7C84 
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SELECTICNeceee 


SELECTICN CARC C1lC 3172223 


LEAST SCUARES REGRESSION CCEFICIENTS 


0.€5S926 


949712 -5S9.84€8C8 


Se 


3-13794C 


1.643151 


ERRCR CF ESTIMATE= 


STO. 


COVARIANCE MATRIX CF THE ESTIMATES 


ACULSTEO MLLTIFLE CCRRELATICN CCEFICIENT 0.776752 
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APPENDIX D 


COMPUTER PROGRAMS 


ia 


A. JOINT GENERALIZED LEAST SQUARES PROGRAM 
1. Program Description : 

The joint generalized least squares computer program 
is designed to read in a set of data and then carry out Oint 
generalized least squares computations as anne plea ton a con- 
‘trol card, and selection cards. The program uses a number 
of IBM 360 Sclentific Subroutine packages to do the calcula- 
tions. It is programmed using FORTRAN IV language much like 
the Multiple Regression program in the scientific subroutine 
package (REGRE). The program conducts a number of standard 
multiple linear regressions (one for each subsystem CER). 

The residuals from the single regresions are saved and uti- 
lized to compute a matrix of correlations between selections. 
Both of these items are listed in the output. Next the 
program does the joint generalized least squares calcula- 
tions; initially 8, the matrix of mean squares and products 


of the least squares residuals, is computed, next b the 


5? 
joint parameter estimate vector is computed along with V(b 5); 
the covariance matrix of the joint estimates. Finally, a 

set of joint generalized least squares prediction interval 
values is calculaved. The program was designed to be easy 
to use for analysis utilizing the joint generalized least 


squares method. Double precision was used to improve accuracy 
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by reducing roundoff errors. The program will handle up 


to thirty-six observations and nine subsystem relations. 


* wine nl: ~ 


Each subsystem CER may have up to three explanatory variables. 
The program takes 280 K of core storage space to run with — 4 


a maximum run time of about thirty seconds. It should be 


“ noted that larger dimensional problems may be possible but 


computer capacity rapidly becomes a constraint to be con- 


cerned with. The scientific subroutine ARRAY was used to 
allow variable ‘dimensioning so that those subroutines that 
neal with matrices can operate on any size array, limited 
only by the maximum program dimensions. 
2. dJGLS Program Users Guide 

The program listed herein is straightforwara to use. 
The user must supply as input a data deck of independent and 
dependent variables. The data array is presently programed 
to store up to forty-one variables and up to thirty-six | 
observations for each variable. The user should supply the 
appropriate read statements in the program to accommodate 
the data format he is using. After the data is read in any 
transformations desired may be made. 

a. Control Card 

| One control card is required for each program 

and is read before the data deck. This card is prepared 


as follows: 


108 


fon ee a TES Rt Sthe ty SARS RNS OEP Me a Saat ee 
AUS WSS A AE HS Sec eete abs bys 


Fy aE NS se TURE Ata tN eR RN a Oe epee A ORR AE INET CREEL 


ECOL EERE ORR BRT MRIS OE ES IST NSN IRIE nN Tsar or al 


ay ele Pont 
TR eae ricinds *, 
et wit te 


: 

: 

i 

be 

be 

|e. 

; COLUMNS CONTENTS SAMPLE . 

Fe <r Sa es oe 

| 1-6 Problem Name Escort 

, o& : 

Fe 

a: 7-11 - Nu ver of Observations 36 

Fo: 12-13 Number of Variables 4 
14-15 Number of Selection Cards 04 


7 
t 
" 
e 
; i 
E 
5 
p 
‘ 
E 
g, 
LY 
| 


b. Selection Card 
The selection card is used to specify the type 
of transformation desired, the dependent variable and a set 
of independent variables in a subsystem multiple linear 
regression analysis. One selection carc. is required for 


each subsystem in the model. The variables are designated 


as columns in the data array. The selection card is prepared 


= 


as follows: : 
COLUMNS CONTENTS ’ SAMPLE . 
1-2 Transformation Code 
00 Linear 
O01 Log Linear GO 
3-4 _ Dependent Variable 
Designated for the 
Regression ey 
5-6 Number of Independent 
Variables Included in 
Regression Ol 
7-8 8t Independent Variable 
Included 21 
9-10 24 Independent Variable : 
Included 3 
11-12 ac Independent Variable 4 
Included 4 


Miglduor 
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The input format 3612 is used for the selection card. 
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c. Deck Setup 
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The deck setup to run the program for a number 


of selections is as follows: 


ae SEARS Ion seat tee J 2 


1. Main Program . yt 


i 
E: b 
: i 


2. Control Card 


main program. 


4, Selection Cards (One selection card for each subsystem 
multiple linear regression). 


The joint generalized least squares program is listed in the 


following section of this Appendix. 


3. Data deck (Read statements must be supplied in a 
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